DOCUMENT BESOHE 



BD 087 856 



CE 000 908 



AUTHOR 
TITLE 

INSTITUTION 

PUB DATE 
NOTE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Kooi, Beverly Y. 

Planning and Neasurement in School to Hork 
Transition. 

National Inst, of Education (DHEN) , Washington^ 
D.C. 

29 Nov 72 
65p. 

!!F-$0.75 HC-$3.15 

Career Education ; Demonstration Programs; Educational 
Development; "^Educational Programs; Educational 
Research; ^Measurement; Measurement Goals; 
^Measurement Techniques; ^Models; Research 
Methodology; Systems Analysis; Systems Approach; 
"^Vocational Adjustment 

"^National Institute of Education; NIE; NIE 
Archives 



ABSTRACT 

An analysis, development, and research (ADR) approach 
for planning educational research and development programs vas used 
as a model for planning the National Institute of Education's 
School^To-Hork Transition Program. The ADR model is system oriented 
and utilizes an iterative approach in which research questions are 
raised as others are answered. Four levels of analyses (further 
definition of NIE program goals to include specific behaviors, 
definition of direct treatments to achieve goals, test treatments in 
a work situation, and adjust treatments after populations and 
contexts of program operation are analyzed) are combined in a fifth 
level where a complete program is presented. Answers to questions 
left unanswered by the model in the school-to*-work context were 
sought using measures in six areas: identifying and monitoring 
changes in the societal problem (using existing surveys); collecting 
data for hypothesis generation (using existing longitudinal studies) ; 
identifying and legitimizing desired outcomes (using an appropriate 
existing set of objectives) ; identifying and screening entering 
populations; ensuring integrity and replicability of treatments for 
individuals and institutions; and determining achievement of student 
outcomes and transfering control of evaluation to the students 
theoselves. (Additional relevant materials are contained in 
appendixes.) (AG) 
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Planning and Measurement in School-to-Work Transition 

This paper describes an analysis, development, and 
research (ADR) approach for planning educational R&D programs. 
It also discusses the different kinds of measures that would 
be required to use that mo4el in the School-to-Work Transition 
Program proposed by NIE':S new Initiatives Task Force. The 
paper's dual purpose is to spark some interest in using the 
ADR model foaf program planning and to contribute to plans for 
School-to-Work Transition. 

The ADR model was described and discussed at an October, 
1972, meeting of members of 'the Career Education Task Force and 
New Initiatives Task Force. Part I of this paper presents the 
model discussed there; Part II, drawing upon an August planning 
paper written by Harry Silberman, illustrates the model in the 
school-to-work context; and Part III describes the program 
measures that are available and needed. 

I. An Analysis, Development, and Research (ADR) Approach to 
Program Planning 

The ADR model is an iterative approach to Research and 
Development. That is, it proposes a sequence of research analysn&S 
which lead to development and demonstration activities, which 
in turn raise further research questions that must be answered 
before development can be completed and replicated successfully. 
A second feature of the ADR model is its system orientation. 
While most program planning accounts only for activities directly 




led to individuals in order to change their behavior, the ADR 
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model goes beyond these first order treatments. It Includes 
activities directed toward structural changes in institutions, 
or second order treatments, that must take place if the first 
order changes are to survive without the special dispensations 
usually granted to experimenters. Finally, the ADR approach 
includes an analysis of sub-populations and different contexts 
in which replication of the developmental program is expected. 
This helps the experimenter to anticipate wide scale implemen- 
tation problems and to devise, during the development process 
itself, strategies for overcoming such problems. 

On October 30 a diagram to represent the model was cir- 
culated to members of the Career Education and New Initiatives 
Task Forces. This diagram, with minor changes in the explana- 
tion, is shown in Figure 1. 

In the diagram, the Policy Analyses are nxunbered from 1 
to 5 to show their probable sequence. That is, an analysis 
of the outcomes desired for individuals and the treatments that 
are likely to produce those individual outcomes (first order 
change) should be closely followed by an analysis of necessary 
institutional or second order changes (Al and A2 respectively 
in the Figure 1 diagram) . A3 established the prerequisite re- 
lationship between the second order institutional changes and 
the first order sxabject changes. A4 is concerned with the 
replicability problem, and is an analysis of subject or 
^nopulation characteristics and contextual characteristics (rural/ 
ERJC .K^^^ fQj. example) that might interact with treatments. A5 is 



the analysis that combines the components into a total program 
that operates in a real setting. 

Though the planner is concerned with the analysis steps and 
their resulting policy documents, the activities upon which those 
docxaments are based should not be deemphasized. An important 
task is determining what the outcomes, treatments, population, 
and environments are for this program. Since this must be done 
at more than a conceptual level, the definition will require 
measures. Once the components are defined and their existence 
in the program can be determined, establishing the causal rela- 
tionship between a treatment and outcome may require developmental 
activities, observational studies, use of unique measures, and 
experimentation. These are represented on the model diagram as D 
for development and R for research. Because research is not 
expected to be ,the initiator of analyses and developmental acti- 
vities, but rather to follow from their needs, the R is shown 
growing out of the T/0 development level. With this variety of 
research and development combined with iterative planning to reach 
analysis level 5, the model's implementation is likely to span a 
period of several months to several years, depending upon the nature 
of the program. 

II. An ADR Model of the School -Work Transition Progra-m 
A. Program Description 

The proposed NIE School-Work Transition program has 
as its primary goal the identification and implementation of 
ERJ[Cthods for easing the transition of yomig people to adulthood* 



5- 



The program has three central themes or hypotheses to be tested. 
It suggests that young people will be more satisfied and success- 
ful in adult roles, more adaptable and flexible in occupational 
choice throughout life, and more successful in work situations if 
their education includes these three items: 

- a wide variety of work, avocational, and service 
experiences 

- exposure to adults who have many different roles 
in society 

- allowance for recurring educational experiences 
throughout life rather than the current pattern 
of full time school followed by full time work. 

Because schools are structurally unable to provide these components, 
the new program would change the locus of education to the work-- 
place, where important decisions are being made, where contact 
with influential adults is available, where real consequences 
result from what one accomplishes. The learning experiences would 
be conducted entirely within an organization which has reorganized 
itself internally so that the young people are integrated into 
its most important activities. The experiences provided there 
would not be intended to impact specific occupational skills so 
much as to help students aoguire the generalized coping behavior 
and attitudes necessary in the adult world. 



^ (1) Harry P. Silberman, "An NIE School-Work Transition 
FRir Program," National Institute of Education, August 4, 

'ti^ 1972. (Unpublished) 
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Of course, the expected effects of a variety of work 
experiences and role models, and a change in the traditional 
school-then-work pattern of education represent hypotheses to be 
tested, rather than already-proven statements. The purpose of the 
R&D program "is to define and test these hypotheses, and the ADR 
model describes a sequence of activities for doing just that. 
The following sections work through the model, providing examples 
of the kinds of planning and R&D products that would be involved. 
B. Level 1 Analysis 

In its first level of analysis, the model calls for 
definition of desired outcomes and of direct treatments for 
individuals in order to achieve those outcomes. Though the 
School-to-Work program's goals are already stated as satis- 
faction, flexibility, and success in adult roles, the objectives 
must be defined by more immediate behaviors that are assumed to 
promote program goals. For example, we may seek to help students 
feel in control of their own personal lives, to confidently 
engage in activities, to have well organized, effective work 
habits, and to be honest and considerate in interpersonal rela- 
tions. These more immediate behaviors in turn must be defined by 
more specific behaviors. That is, people who feel in control of 
their own lives can make decisions and follow up on them, and 
have relatively accurate self knowledge. To be more specific 
yet, they can state the purpose of their own activities, can 
j>lan for future security by buying insurance or budgetting in- 
E^^me, can judge their own work or product quality with fair 



accuracy, feel able to and responsible for choosing an occupa-* 
tion and feel able to perform successfully on a job. Individuals 
who are confident enjoy learning new things, can perform a 
variety of tasks or the same task in a variety of situations, 
find interesting things to do, routinely compare new ideas and 
opportunities with old ones, etc. Honesty and consideration in 
personal relations includes being willing to help others learn, 
finding and approaching appropriate people for information, 
recognizing that people have different attitudes toward work, 
friendship, and life in general, accepting family and community 
responsibility, etc. A list of good work habits may be even 
easier to develop. Much more complete lists of behaviors than 
these, along with the way they appear in typical activities and 
interactions of young people must be defined as part of Analysis 
1 (Al) in the ADR model. 

A second part of Al is a definition of direct treatments 
that are likely to promote development of the desired outcomes. 
The School-to-Work Transition program should provide exciting 
opportxinities for learning theorists in this part of the analysis. 
It can allow them to extend the principles discovered in labora- 
tory and classroom to a broader learning arena. Role modeling, 
intrinsic rewards, applying incentives, timing of learning 
activities, graduated difficulty of tasks, appropriate practice, 
variation of experiences for generalization, etc. are all likely 
to be important. For example, the student in a workplace is 
ERJC ikely to: 
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- appropriately imitate a person he sees rewarded or 
punished for work performemce 

- have a pleasant feeling of power when his decisions 
are carried out 

- be discouraged from undertaking new things if he 
faces too many difficult tasks and fails 

- remember those activities he practices 

- be eager to learn when instruction comes just 
before he is asked to use what he learns in a job 

- perform new tasks when he has had the opportunity 
to undertake similar tasks in different settings^^^^ 

The School-to-work Transition, by proposing a wide 
variety of work experiences / exposure to adults in different 
roles, and recurring cycles of education and work, already 
builds in several of these principles in a way that schools are 
structurally unable to do. However, not all work experiences 
would be equally educational, and not all adults would make 
equally good models. The program designers in the Al analysis 
must identify, perhaps using principles like those above, the 
characteristics of learning places that are most likely to 
promote outcome behaviors. 



For example, a person who has obtained bus routes 
cuid schedules, ordered college catalogs, called the 
city for informcition on codes and regulations, is 
likely to be able to find out where his polling place 
is and what the residence rules for voting are. 



(2) 
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C. Level 2 Analysis 

Although first order treatments and outcomes may be 
found workable in an experimental setting, they frequently fail 
when moved to institutional settings within society* Considera-* 
tion of what it would take to move from leiboratory to real world 
setting is the task of Analysis 2. For example, we do not know 
what it would take for a compcuiy to accept a group of high achool 
students and let them try a number of jobs that are vital to 
production or services over a period of months. Nor do we know 
what would make parents accept such experiences for their 
children in lieu of academic, classroom presentations. What 
wage level would satisfy both students and unions and how much 
is the very strong public school institution - especially in a 
time of teacher surplus - willing to give up? We do not know 
how to help career education programs compete with the prestige 
of academic education, nor how to adjust supply of such an educa- 
tional alternative with geographic and temporal differences in 
its demand. Each of these second order outcomes and the insti- 
tutional treatments that will be required to achieve them are 
difficult to identify and uncomfortable to consider, but are a 
matter of grave concern. Though A2, or the analysis of such 
second order treatments, is sequenced after the plamning for 
direct learning experiences, it should begin quite soon in the 
planning process, and rely heavily on non-educators. That is, 
O >liticians, management experts, and representatives of private 
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enterprise should join with social scientists in specifying 
institutional outcomes and second order treatments to achieve 
those outcomes. 

D. Analysis Levels 3, 4, and 5 

The major concern in A3 is to synthesize and adjust the 
fairly separate first and second order treatments so that learning 
experiences which cannot be accommodated by the relevant insti- 
tutions are not being proposed. A3 has many of the characterise 
tics of a trade-off analysis. That is, how much institutional 
change does it take to get a particular direct treatment to 
function? Is the outcome worth the effort of institutional 
change? Does the institutional change cause some other part of 
the institutional system to malfunction? Is the program's out- 
come or purpose worth that malfunction (or repairing it)? 
Because this level of analysis has not been undertaken for the 
School-to-Work Transition program, one can only guess at what 
some of the variables might be: 

- costs to firms of productivity loss . 

- effects upon older marginal employees 

- costs to government of possible tax write-offs 

- problems, of raising aspirations beyond what the 
job market will support 

- amount of reorientation possible before a work- 
place turns into a school 

O " side effects of conflicting program values and 

ERIC 
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cultural values (e.g. competition vs. cooperation 
in Chicane and Indian cultures) 

'I 

- interactions of race with the program's plans for 
role models 

- changes in colleges and universities if such a pro- 
gram is successful 

- etc. 

While many of these variables fall into A2, they become a part 
of A3 when they are considered in relation to trade-offs with 
different degrees of the treatment/outcomes involved in Al. 

A4 is an analysis of populations and contexts to which 
the program might be expected to generalize. The R&D plan 
calls for a program for all youth. A4 identifies (1) student 
sub-groups - black, female, rural, alienated children of the 
affluent over achievers, etc. - that have characteristics different 
enough to require differences in treatment, and (2) context 
differences that might be resources for, or interfere with 
treatments. Possible examples of contextual variations are 
concentration of industry, strength of unions, conservative vs. 
liberal environment, influence of nearby colleges, availability 
of small business cooperation, extent of government employment 1^ 
nearby, etc. Though A4 is ostensibly concerned with problems of 
generalizing an initially successful progrcun, and for that reason 
is placed fairly late in the analysis sequence, an earlier ini- 
O :iation of this task might allow sampling of subject/context 

ERIC 
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configurations for the original experimental tryoutSi thus 
greatly improving probability of successful implementation of the 
program on a broad scale. 

The final level of analysis - A5 - presents a complete 
R&D program that considers relationships among direct treat- 
ments and outcomes, second order institutional treatments and 
outcomes, and problems of implementing the program with new 
people at new sites. It is a program based upon collection and 
analysis of various kinds of data, upon developmental and research 
activities that establish the direction of causal relationships 
between treatments and outcomes, and upon synthesis and considera* 
tion of these imputs by experts with appropriate knowledge and 
skills. 

E. Placement of R & D examples within the model 

The August planning paper for School-to-Work Transi- 
tion contained a list of suggested research and development pro- 
jects that might initiate the new program. The projects were 
categorized according to whether they focused on providing 
new learning experiences, exposing youth to new adult roles, or 
building better articulation between school and work. The list 
was drawn up before the model was conceived, but in order to 
test how well the model accommodates a variety of activities, 
each of the R&D suggestions were categorized within the model. 
(See Appendix A) This was not difficult to do, and actually 
O avealed more interesting things about the list than it did 
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about the model. First, no siiggestions went beyond the A2 
level of analysis, and not all components below that level were 
treated by a suggestion. Second, the School-to-Work articulation 
section had no suggestions related to direct treatments or out- 
comes for students; all of its activities were related to insti- 
tutional change. The Role Models suggestions, similarly, had very 
few items, and almost none of these were concerned with student 
outcomes. 

These gaps suggest several things. One, obvious ly, 
is that Dr. Silbeinnan never meant for the paper to outline a 
complete R&D program, but rather only to briefly discuss in- 
teresting components. A second is that the three components of 
the paper - experiences, role models, and articulation - do not 
stand alone, but probably should be fit into one program. 
Third, the program planning would benefit from a systematic 
following of the model, working out in complete detail each level 
of analysis r The examples and discussion presented earlier 
might assist those who attempt this systematic planning^ 
Another step that is very important to take is the identifica- 
tion of measures, or their development, for each outcome, treat- 
ment, population characteristic, and context, as soon as these 
components are defined. In some cases, iterative development of 
measures may even help define the component. 
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III. Measures for School-to-Work Transition 

Measures are defined quite broadly for the purpose of this 
paper, "rl^ey include all procedures for the systematic collection 
of data to describe characteristics of people, places, and 
activities. They support our inferences about observed consis- 
tencies in the environment and the explanation for those consis- 
tencies. In educational development they provide evidence that 
a program is needed^ that replicable treaitments do exist, and that 
particular effects follow the application of those treatments. 

There are at least six problems associated with the School- 
to-Work Transition program which require measurement: 

' A. Identify and monitor changes in the societal problems 
that the program addresses. 

B. Collect data for use in hypothesis generation. 

C. Identify and legitimize desired outcome. 

D. Identify and screen entering populations* 

E. Ensure integrity and replicability of treatments for 
individuals and institutions. 

F. Determine student outcomes, including transfer of 
control of evaluation to the student himself. 

Each of these problems of measurement is discussed below, des- 
cribing some of the existing n^asures and gaps and indicating 
where each measurement problem is relevant in the ADR model. 
A. Identify and monitor changes in the societal problem that 




. the program addresses. 
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The School-to-Work Transition program addresses the diffi- 
culties that youth have in becoming adults. There are many 
likely indicators of such difficulty: expressed dissatisfaction 
of both youth and adults f high rates of unemployment for young 
people, wide spread under^-achievement in school r youthful van- 
dalismi demonstrations, etc. Certainly an experimental program is 
not likely to cause dramatic changes in such indicators until it 
has proven successful and been implemented on a broad scale. 
However, collecting the data on a continuing basis will assure 
policy makers of the need for program development and may give 
insights into needed emphases in the R&D effort. These con- 
siderations are largely a part of Analysis level 5 in the ADR 
planning model. 

Characterizing the state of the problem in the nation can 
be done with fairly large cross sectional studies that use 
representative samples and are repeated at periodic intervals. 
Since the purpose is not to trace particular people or to infer 
causality, longitudinal studies are not strictly necessary. 

The current cross sectional data collection that is po- 
tentially most useful for Career Education is the Career and 
Occupational Development (COD) Section of National Assessment. 
Because the general purpose of National Assessment is to report 
on educational achievement in the nation, other parts of the 
data will be of secondary interest also. The plan is to draw a 
O ample of 9, 13, 17, and 25-year olds for two assessments, five 
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years apart/ with especially developed exercise^. The sample is 
dravm so that no examinee takes all exercises, and there are 
2/000 responses for each exercise. Information is broken dovm 
by region, size and type of community, sex, color, and SES. 

Because the COD objectives are available now, ^-^^ the content 
can be identified in some detail. Information will be collected 
on planning and decision making skills, general skills like com- 
munication and arithmetic, work habits, and attitudes toward work. 
The exercises are currently being tried out, and assessment is 
planned for 1973 and again in 1978-1979. The project permits 
use of anything that is published, but the exercises will not be 
published until 1975 when the analysis is complete. Only 50% 
of the exercises will be published then, since they are to be used 
in the later assessment. It is expected that any analysis of the 
data for special purposes will have to be undertaken and funded 
by the interested agency. 

The greatest shortcoming of National assessment for planning 
R&D programs is the lack of access to the exercises; all planners 
can do is guess whether specific questions will suit their needs • 
A second problem is the time line. The 1975 date for completion 
of the smalysis precludes its use in program plcuining and 
development - for three years at least. Finally, the breakdown 
provided - region, age, size and type of community, sex, color. 



(3) Objectives for Career and Occupational Development , 
National Assessment of Educational Progress, Denver, 
Colorado, 1971. 



17. 

and SES, is probably too narrow to identify population charac- 
teristics that could be the basis of unique treatment groups. 

The COO objectives seem interesting. If the exercises 
promised as much and were available , they could be used for small 
intensive surveys of specific populations to give more usable 
information about transitional problems in society. If a few 
questions could be added to the current study concerning amount, 
kind, and quality of work experience, the planners might get some 
interesting correlates with the attitudinal responses. 

A second data collection effort - largely cross sectional - 
that could prove useful in identifying youth transition problems 
is the Current Bdpulation Survey. This joint Bureau of Census - 
Bureau of Labor Statistics venture provides data from economic 
and employment indicators on a monthly basis. An interview is 
conducted on the 19th of each month sampling 863 counties and 
independent cities in 449 areas. Each sampled household is in- 
terviewed for four consecutive months, followed by eight months 
without interview and then four more months of interviews. One 
person answers questions for the whole household. Part of the 
sample changes every month, with 75% common from month to month 
and 50% common from year to year. 

Data is collected routinely on (1) rate of unemployment by . 



(4) Concepts and Methods Used in Manpower Statistics from 
The Current Population Survey , Bureau of Labor Statist- 
tics Report #313. Current Copulation Reports P-23, 
#22, June, 1967. 
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duration, industry , occupation , sex, age, color, marital status, 
and labor force time lost; (2) employment by sex, age, class bf 
worker, occupation, color, number of hours worked, and persons 
with a job but not at work; (3) labor force size, sex, age, and 
color; (4) persons not in the labor force and (5) seasonally 
adjusted data. 

Though this list is not impressive as far as program planning 
is concerned, additional inquiries are made for special reports. 
For example, data on work experience of the population, multiple 
job holders, employment of school age youth, employment of high 
school graduates and dropouts, educational attainment of workers, 
why the lanemployed started looking for work, etc. are collected 
on some occasions. The reports are usually published in the 
Monthly Labor Review and might be useful to planners. Also, it 
seems possible that NIE might get some of the questions they wish 
to have answered on a periodic basis included. Because of the 
obvious efficiency of "i^ooking on" to an existing survey, this 
should be investigated. 

Finally, there are many one-*time surveys the results of which 
should be considered and synthesized, not only for cross<-sectional 
information, but also for trend possibilities. For example, quite 
a number of studies on aspirations and values of youth were 
recently collected and abstracted by a group at the College of 
Human Development, Pennsylvania State University. These might 
O examined for possible changes in attitude over a period of 
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years. Actual behaviors indicative of transitional problems 
have also been the subject of one-time studies that should be the 
object of a literature search. A good example is a study 
conducted about three years ago on disruption in public schools, 
in which the extent of fairly specific disrupting behaviors 
(e.g. teacher or student boycotts, arson, property damage, rioting ^ 
picketing, physical confrontation, etc.) was determined for 
schools in each region of the country. 
B. Data for use in hypothesis generation 

Though cross-sectional studies like those described in 
Section A can contribute to generating proposed solutions, long- 
itudinal data are probably needed also. This is because we can 
more justifiably infer causality when we find that one event 
consistently follows another. Consider three hypothetical ex- 
amples of relationships that might be discovered in a longitudinal 
study: 

(1) High school students who are held responsible for some 
work grow up to feel able to succeed in a career. 

(2) Workers who have had young trainees to introduce to 
their job later feel more secure about their own skill. 

(3) Girls who, at a very young age, do tasks that require 
mechanical skills grow up to feel as competent as men 
more often th^ girls who do not try such tasks. 



(5) Bailey, S, K., Disruption in Urban Piablic Secondary 
Schools, Syracuse, University Research Corporation. 
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If we discovered these relationships , we would have three hypo- 
theses that are probably worth the expense of a direct test in a 
developmental program. The first exan^le is concerned with direct 
treatment to individuals and thus falls in the Al/Tl level of the 
ADR model. The second/ more concerned with benefits to the 
industrial institution, is probably a part of the A2/T2 levels 
of analysis. The third example relates to a specific population 
and falls into the A4 level of analysis. 

There are several existing longitudinal studies that might 
provide some data for hypothesis generation in the School-to- 
Work Transition program. In one or two cases the studies could 
be extended to gain more useful information, thus avoiding a 
completely new study. Finally, studies of the treatments and 
effects of other manpower programs might lead to testable hypo- 
theses for the program. 

The longitudinal studies that seem most likely to be useful 

are the Labor Department's studies of the educational and labor 

(6) 

market experience of male youth and of young women. The purpose 
of these studies was to identify variables that permit some 
members of a given age-education-occupation group to succeed in 
work while others do not. 5,000 male and 5,000 female siabjects 
between the ages of 14-24 are being interviewed annually. The 
project, which began in 1966 for boys and 1968 for girls, is 



Q (6) Herbert S. Fames of Ohio State University was principal 
ERylC investigator in the project. 
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collecting biographical, health, attitudinal, work experience, and 
occupational information through personal contacts with each 
interviewed. Questionnaires are also being sent to schools to 
collect data on observable aspects of school quality. 

The project has resulted in three major reports for each 
year's interviews with the young men^^^ and one for the young 
women A sample of findings from Volumes I and III on young 

men may give some insight into the data. 

- From the first year study of young men; Students 
and those not in school hold different kinds of jobs. 
Construction and manufacturing account for about half 
of the out-of -school youth, but for less than a fifth of 
the students. Trade and service indistries employ almost 
two-thirds of the students in contrast to less than a 
third of those not in school • . - 

- Most employed students found their jobs through friends 
and relatives. The \inemployed seeking work place much 
more reliance on direct contacts with employers. ^^^^ 

- Young people who make an occupational change are much 
more likely to make a substantial change, from one 
occupational group to another, than a slight change 



(7) Career Threshholds , VI, VII, and VIII. Manpower Research 
Monograph #16, U.S. Dept. of Labor, 1970-1971. 

(8) Years for Decision , VI, Manpower Research Monograph #24, 
Q U. S. Dept. of Labor, 1971. 
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within a major occupation group ^ ^^'^^^^ 

- For the total group of white youth, there is no difference 
in degree of job satisfaction between" high school drop- 
outs and thoae who received diplomas. ^P*^^^^ 

- Within the white collar group degree of job satisfaction 

is directly related to educational attainment, while 

within the blue collar group the relationship is 
inverse. 140) 

- Farm workers, professional and technical workers, and 
craftsmen are most likely to like their work best for 
its intrinsic qualities. Extrinsic factors are selected 
most often by salesmen and men in the clerical and 
service occupations. ^^^^ 

- Extrinsic characteristics of jobs, if unsatisfactory, 
can produce job dissatisfaction, but they are generally 
insufficient > even if attractive, to create feelings of 
satisfaction with a job. 

Prom the third year study; 

- Additional job opportunities under child-labor laws and 
eligibility for a drivers license are more highly 
related to getting a job than increased knowledge and 
greater flexibility of hours. ^P*^'^ 

- Between 1966 and 1968 more than half the young men 
changed jobs and three-fifths changed their type of 
work. Job changers-.en joyed larger wage increases and 
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more job satisfaction than non-chajigars • 
These relationships seem interesting enough for NIE invest- 
ment in a closer look at the data. The LedDor Department is making 
the tapes available as well as all relevant materials, and has 
published an invitation to interested researchers to use them. 
Some funds for such study will be available from the Labor 
Department itself. There are obvious limitations in the data, 
however. The job satisfaction and job attachment measures rely 
on very few questions, information on the qualitative nature of 
high school jobs and on unpaid high school work and service 
experience is almost entirely absent. 

There are several other longitudinal studies which are less 
extensive in time or sample size, and use self-administered 
questionnaires rather than interviews to collect data. Among these 
are the NCES Longitudinal Study, Project Talent, and the Youth in 
Transition study. The NCES study collects attitudinal biographi- 
cal, occupational, and achievement data on a national sample of 
16,000-20,000 high school seniors, and repeats the data collection 
with appropriate changes 18 months later. Instruments for the 
base year study were developed in 1971 by Research Triangle 
Institute. In 1972 Educational Testing Service revised and 
implemented the base year instruments. The same company has 
developed follow-up instruments for Fall, 1973 implementation by 
the Census Bureau. These questionnaires are currently being 
Revised. 

ERIC 
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One of the major shortcomings of the study from the view of 
program planning is the lack of qualitative information sought on 
the work situation. Students are asked little more than how many 
hours a week they work* Another problem is that the length of the 
instrument and wording of the questions are likely to discourage 
serious consideration by students, especially when they have left 
school and are no longer "captive." Since NCES staff members 
seem eager to have suggestions, NIE might well have some input to 
correcting these shortcomings, but action must come quickly if at 
all. Appendix B contains a memo which discusses the study and 
suggestions for change in a little more detail. 

One of the goals of Project Talent is to formulate a better 
understanding of how yoimg people choose and develop their life 
work. Data are collected at periodic intervals between 1960 and 
1983 on students who were in grades 9-12 at the beginning of the 
project. The information includes achievement scores, biographi- 
cal data, interest and personality test scores. Though the data 
tapes are available and a nximber of interesting studies have been 
done using them. Project Talent has at least one major short-* 
coming. Its loss of subjects is great; for example, only 31% of 
the 9th graders remained in the sample f.^ve years after they left 
high school. Though NIE should be alert to interesting studies 
that use the data, planners will probably find other sources more 
useful in hypothesis generation. 

. The final longitudinal study to be mentioned i« the Youth in 
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Transition study, directed by Jerald 6. Bachman of the Survey 
Research Center of the University of Michigan. Though the purpose 
of the study was to examine the cause and effects of dropping out 
of high school, the data can address some broader questions. 
The subjects were 2,000 tenth grade boys for whom information was 
collected in the Fall of 1966, the Springs of 1968 and 1969 and 
one year after they left high school in the summer of 1970. 
73% of the sample still remained in the study at the Inst date 0^ 
collection. Information was collected on family backgroxind and 
intelligence, on differences among high schools and vocational 
programs, and on post high school environments. JUnonq the study's 
findings are that high SES, getting along with parents, Jewish 
religion, and high self-esteem are all related to not dropping 
out. Personality dimensions showed little change when a student 
dropped out. Work experience was related to aspiration and a 
need for self development, and there were positive relationships 
between self esteem and a need for self development and aspiration. 

The people who conducted the study are proposing a 1973 
collection of data. Among the purposes of the follow-up are 
these: 

(1) Excunine the impact of early part-time emd part- 
year job experiences during school. 

(2) Try to distinguish between those who remailn 
steadily employed and those who do not, and then 

O search for correlates of the behavior. 
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(3) Describe the standards by which jobs are judged 
acceptable to different youth • 
These questions are certainly pertinent to hypothesis generation 
for School-to-Work Transition^ and the project's research staff 
invite cooperation of the agency in developing other questions. 
Supporting this study certainly seems a cost effective and quick 
way for NIE planners to collect needed information. The research 
staff's preliminary proposal is included as appendix C to this 
paper . 

A final source of information for hypothesis generation is the 
assessment of treatments and their effects in other manpower 
programs. Neighborhood Youth Coirps (NYC) and the Job Corps ^ 
though they have a relatively narrow target population, do have a 
lot of experience and an interesting backlog of research. Job 
Corps, particularly, has some fittKBOBtateg techniques for collecting 
^ data ana a wealth of research informati^on available to predict 
who does well in their program. One of the most interesting studies, 
however, was done by Richard E. Sykes, using an NYC population. 
Six factors were described as important in the work environment 
of the youth in the study. They were placement in: 

- an existing, structured adult job rather thcui a newly 



(9) Sykes, R. E., A Pilot Study in Observational Measurement 
of Behavioral Factors Associated with Increased Employ- 
ability of Out-'Of -School Neighborhood Youth Corps 
Enrollees I Contract 4l-7-00§-25, Dept. of LeiSbor,' 
O „ University of Hinnesota, Dec. 1969. 
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invented one 

- a task that is necessary to the organization 

- an activity with high status 

- a task that involves learned skills 

- a job that is similar to an adult role 

- a job requiring interaction with adults 

Though this was only a pilot study and the observations remain to 
be rigidly tested, this kind of work can be a good contribution 
to design of treatments in new prograiii pleuining. 

Almost all of the available work reported here has been at 
the direct treatment or Tl level of the ADR model. Though the 
neglect of the T2 or institutional treatment level of analysis is 
partly due to a shortage of this writer's time, another major 
factor is simply the newness of such change as a part of educational 
research. One of the greatest gaps to which planners must address 
themselves is the collection of data and generation of hypothesis 
about institutional changes that must take place to support the 
learning treatments. 

C. Identify and legitimize desired outcomes for students. 

Identifying desired outcomes for students is a part of 
Analysis level 1 in the ADR model and is included as a measure- 
ment problem because measures cannot be developed xintil objectives 
are defined. Not only must definitions be specific and clear, but 
the designers of the program must understand and accept the ob- 
?^ctives. Also, the objectives must be recognized and accepted by 
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both the professional community and the public at large if the 
program is to be implemented on a broad scale after experimenta- 
tion. To satisfy these requirements , program designers need to 
personally examine outcomes in relation to the specific behaviors 
that are implied and to acceptability in terras of their own and 
society's values. Personal commitment is probably most complete 
when the designers develop objectives for themselves, but the 
objectives must also be made public so that unanticipated reactions 
to them are less likely to arise at a later date and interfere 
with program implementation. In order to shorten this "legiti- 
mizing" process, the program planners might make a list of ob- 
jectives for themselves - one to which they can feel committed - 
then search the literature for similar statements that have already 
been exposed to public scrutiny. If a fairly close match is found, 
some adaptations might produce a list that elicits the planners' 
personal commitment and still has the legitimacy of the published 
lists. 

This writer fairly successfully attempted such a procedure. 
The objectives (listed in Appendix D) were originally created, 
but the National Assessment Program's Career and Occupational 
Development (COD) Objectives were located later and foiind to be 
a good detailed statement of nearly the same attitudes and be- 
haviors. Obviously, the COD objectives have much more detailed 
development and public tryout. A second exaiaple of fairly similar 
objectives are those of the Life Skills Education Project under 
O 'le direction of Winthrop Adkins at Columbia University. A third 
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set of behavior categories was developed at a September, 1972, 
conference on Coping Skills held at the Appalachian Adult Education 
Center. Figure 2 lists the areas of objectives for each of the 
lists mentioned above. 

Because the National Assessment objectives have been so 
completely developed and widely distributed, it is recommended 
that the School- to-Work Planners consider them for adoption as 
program objectives, perhaps with a few adaptations to accommodate 
non-work oriented maturity. Their five broad areas are as 
follows: 

I. Prepare for MsJcing career decisions 

II. Improve Cazi^er and Occupational Capabilities (i.e., 
make and implement career plans, and engage in 
school and out of school activities that enhance 
career opportunities.) 

III. Possess skills (numerical, communication, manual- 
perceptual, etc.) that are generally useful in 
the world of work. 

IV. Practice effective work habits. 

V. Have positive attitudes toward work. 

To illustrate the level of the objectives. Appendix D, Part II 
lists detailed definitions for the second and fifth broad areas 
above . 

D. Identify and screen entering populations. 




Identifying entering populations is in^ortant to appropriate 
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Figure 2 



Areas of Different Lists of Objectives Related 
to Maturity in Personal Development 



National Assessment 

1. Career Decisions 

2. Career Preparation 

3. Communication, problem 

solving/ manual skills 

4. Effective Work Habits 

5. Positive Attitudes 

toward work 



Life Skills 
Education 

Self 

Family 

Community 
Job 

Leisure 



Coping Skills 
Conference 

Advocacy 

Aging 

Community 

Consumer Economics 

Education 

Family 

Health 

Housing 

Insurance 

Jobs and Income 

Leisure 

Mobility Skills 
Relating to Others 
Self 
TeuKes 

Transportation 
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design of experimental treatments and to replication of the 
treatments with different populations. These are, respectively 
Al/Tl and A4/S levels of analysis in the ADR model for planning. 
One way to define populations is to accept someone else's 
definition. 

A number of researchers have divided youth into intriguing 
conceptual categories. Dale Tussig, for example, charactiBrizes 
students as three types: ^''■^^ 

(1) one who accepts the traditional economic purpose.': of 
life and has been successful in school and rewarded for achieve* 
ment orientation; (2) one who also accepts the work orientation 
as life's central theme, but has not been successful in the class-- 
room and does not understand how to get the school to help in 
achieving economic independence and security; and (3) the student 
who has rejected the traditional achievement ethic and is casting 
about for new meanings and a new sltoise of purpose in life. These 
are most frequently the suburbcui youth who have never experienced 
want and never seen struggle for security; they do not recognize 
the difficulty that many individuals have making a living, and 
do not see that their striving, business oriented parents are 
particularly happy with their success. "VS calls these types 



(10) Tussig, A. Dale. Post Secondary Education: Where Do 
We Go From Here? Syracuse Policy Research Center. 



32 



maUcers, non-makers, and past-makers respectively. Lionel Lewis 
identifies college subcultures as academic » collegiate, and 
consumer-vocational r depending upon their involvement with ideafl 
and their attachment to their specific achool.^^^^ Theodore 
Ferdinand characterizes college students as Rationalists , Conven- 
tionalists, Pragmatists, and Activists, based on general persona- 
lity dimensions, ^^^^ No doubt many other categorizatiais coxkld.be 
discovered in the literature which might seem to be useful short-- 
cuts to population definition for application of treatments. 
They also have the advantage of avoiding differences based on 
race, sex, SES, etc. 

The problem with the unique categorizations arises when one 
tries to define how the people in them initially behave in relation 
to the program's defined outcome behaviors cmd how the treatments 
should differ for each group. Having attempted the task with the 
original set of objectives found in Appendix D and the Tussig 
categorization, this writer is convinced that the task cannot be 
"arm-chaired." Distinctions become very fuzzy when they are 
examined closely. 

A better approach is for program designers to begin with the 
outcomes, spend some time observing the target groups and collecting 

(11) Lewis, L.S. "The Value of College to Different Subcultur6s 
School Review , V. 77, No. 1, March, 1969, pp. 32-40. 

(12) Ferdinand, T. N. "Personality and Career Aspirations 
Q Amoiig Young Technologists," Human Relations , V. 22, 
JC April, 1969, pp. 121-135. ' 
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data on them, and then try to distinguish among groups in relation 
to the outcome behaviors. In some cases pencil and paper tests 
might help in data collection. A brief review of^ available tests ^ 
shows that they fall into several content categories: 

(1) Measures of work-related behaviors such as leadership, 
supervisory ability, business judgment, management, peer relations 
knowledge of careers and skills needed to obtain a job. 

(2) General personality dimensions and measures of self 
concept . 

(3) Measures of values. 

(4) Interest inventories. 

(5) Personal history questionnaires. 

Typical formats for the tests include asking the examinee to 
check an objective or a statement that describes himself; to 
judge the best or truest of a set of debatable statiements, or to 
choose the best solution to a hypothetical work or social problem. 

One of the most promising paper cind pencil tests for adoles- 
cents is still in development. Neman Freeberg and Richard R. 
Reilly of ETS are constructing and validating a measure of aspira- 
tions, community adjustment, and attitudes toward self and work 
for Neighborhood Youth Corps enrollees. The test consists of 
13 booklets that rely heavily upon illustration to reduce the 
reading level. Development has reached the validation stage, and 



(13) Informal notes on tests included in the review are 
available on request. 



34. 



the test should be available within a year or slightly longer. 
If, upon examination, program designers believe the test is useful 
they might approach NYC for its prior research use and save 
developing a similar instrument. 

The tests generally have several problems. Frequently the 
reading level is too high or the wording too academic; faking 
appears too easy; scores are cast in such abstract tesrms that they 
are difficult to relate to needs for specific empirical treatments 
and finally, content seems out-of-date too quickly, 'tesbe too 
school-oriented, or i^^aar obviously inappropriate for some large 
group - e.g., women, or the poor. On the other hand, the more 
en^irical of the measures, like those more oriented toward work, 
and the personal history indexes might provide useful selections, 
or ideas for developing a test that would be appropriate for 
defining population characteristics in relation to program goals* 
E. Ensure integrity and repliccdDility of treatments for individ- 
uals and institutions. 

Instruments to assess whether planned treatments, are 
occurring both for individuals and for institutions (Tl and T2 
levels of the ADR model) represent the greatest gap in available 
measures. Over the past decade, a number of pragmatic measures of 
environments have been constructed - college and univetsity 
environments, elementary and high school, business and industry, 
home environments, organizational climate, ^^etc. But there is as 




t relatively little common agreement about either the content 
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of what should be measured or about the measurement urdts for 
expressing it. A list of characteristics that help an enviroyxment 
facilitate leamlngr and valid assessment for the items on that 
list would be of obvious value. For the purpose of School-to 
Work Transition, the characteristics should represent general 
classes that can be illustrated by specific examples that are 
appropriate for various objectives, s\ibject, ages, and work places* 
Examples of such characteristics might be as follows: 

- Repeatable activities to allow practice 

- Activities that stimulate information seeking 

- A small group to serve as a basis for identity and action 

- Warm, accepting people to help when a problem arises 

- Activities with recognized standards of excellence to be 
fulfilled 

- Incentives for successful performcuice 

- Activities that allow students to make decisions with 
real consequences 

- Recreational experiences related to learning activities 

- Feedback on how one's behavior affects others 

- Continuity of experiences, peers and adults who instruct 
over a period of time 

Unfortunately the assessment of direct treatments for individ- 
uals probably must be done by questionnaire and use of fairly 
time-consuming observation scales that must be developed parti- 
g"larly for this program. However, because of the newness of the 
^aa, it presents an exciting opportunity to develop new method- 
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ology in measurement that should be appreciated by program 
designers. 

T2 measures have some of the same development intricacies, 
since they are likely to depend upon obsesnration in real settings 
with their lack of laboratory precision and control. Here, how-* 
ever, there are at least three great additional problems. The 
institutional changes are likely to involve societal values, to be 
assessed through very subtle indicators^ and therefore to have very 
delayed implementation. For example, one desired outcome might 
be that the work place should supplement the family in providing 
an "umbrella" of support to young people. That is, the work place 
that has reoriented itself for education would provide references 
for credit, residence, and checking account applications, assume 
some responsibility for legal action of youth, provide a small 
group for personal identification, etc. Measures of such changes 
are likely to come from records and observation;/ iit^lementing them 
is likely to threaten the family institution; and the changes are 
likely to be pretty artificial during the experimentation, actually 
occurring only with passage of time and change of public attitude. 

Again, there is almost a complete assessment gap in this 
area. However, it offers exciting possibilities for collaboration 
of varioys social science disciplines in development of measures. 
P. Determine student outcomes, including transfer of control of 

evaluation to the student himself. 
O The final area of measurement for discussion here is that of 
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Student outcomes, or the 01 level of the ADR planning model. 
Frequently it is the only area that receives serious attention in 
educational programs. It has been left for the conclusion here 
because of a different problem that is involved. 

In School-to-Work Transition one of the most important 
outcomes is that the maturing student learn to evaluate himself. 
Therefore, the evaluation of outcomes becomes not simply a program 
evaluation, but part of the prpgram itself. Objectivaily in evalua- 
tion of others is difficult enough in itself; accurate self 
evaluation is a very subtle skill to teach. The procedure proposed, 
for doing this is to have adults initially do the outcome evalua-- 
tion, applying rules in a way that is observerable and under- 
standable by other persons. When the students understand and are 
comfortable with the evaluation, responsibility should be trans- 
ferred to small groups of trusted peers who can follow the rules 
in a constructive fashion. Finally, the mechanics of the proce- 
dure can be undertaken by the student himself, and as the rules 
become internalized, the mechanics can be required on a more and 
more intermittent basis until the individual evaluates himself 
almost unconsciously. 

Two procedures are suggested for the mechanics of mieasuring 
student outcomes. The first is use of existing records and 
counseling at the work setting - i.e, 

- Absenteeism and Tardiness 
Q - Numbers of training and study groups entered 
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- Fights with fellow workers or peers 

- Ne«mesa ot the work place 

- Requests for change of assignment 

- Arrangements for savings , travel to-and«from work, help 
at home, etc. 

- Time and errors to reach standard production 
*- Participation in organizations and service 

- Requests for help 

These data can be accumulated for program assessment and dis- 
cussed with the student for personal growth. 

The second procedure that appears to have a great deal of 
promise is the "Critical Incident" method of assessment developed 
by Flanagan over 15 years ago. Though it would require development 
of instruonents particularly for this progrsunA, the technique can 
provide a constructive, understandable set of procedures that can 
be used first by adults, then by other students r then by the 
subjects themselves. 

Simply stated, a number of outcome dimensions are identified, 
such as those in the major headings on the next two pages. Then^ . 
typical behavior classes for each dimension are listed under it 
and space for recording inc4;^»nts of each student's behavior in 
that class are provided. (Again, see the examples on the next 
two pages.) 



(12) Flanagan, J.C. Teachers^ Guide for The Personal and 
Social Development Program , SRA Program for the 
Elementary Schools, Science Research Associates, 
Chicago, 1956. ■ ' 
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TRAITS (Taken from the source quoted, pages 51 and 52 ) 39. 



DATI 



BEHAVIORS NEKDIHG 

WHAT HAfPCNCO 



— PCKSONAL ADJUSTMKNT- 



















P 

















TRAITS 
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a. K««d''d to «uvg«ition, puDl«hiB«nt or (Miiiig with: 

aulkiiig, hcMiUa Temarlti, tintrum, crying, dooff f^^wli^^ «io. 
A-2. ruaa)ng «iv«y Irotn pltuation, Kidlag i«c*, stQ. 

b. Criftd. coinpialn«d, oi wti upMl oroi tmtU Kttttr 
Htd d({ii<iu]l]r *d]u«Ung to lilutHoa 

d. Ftn*d lo p«Hicip«U wllh group, Mlhdf«w 

Fftigncd liciiiiM* w gtv« «xc«w l» tvold HWIiiltlMl ittiuttoA 

-MSfONSIIUin AND WW ■ 1 ' ■ i ^ 



a. AHvapltd lo Avoldi doing hit alMra ol work 

b. Did not cairy through wlUi MilgiMd teik 

c. D«wdl*d ot W4« !•(• in doing Urict 
a. FaiMlld do work or a«d* Utti* vlbrt 

Loft, wutvd. or Uiiod to em far wpfJiw, meemf, Vta 

I. FallMilo DOtifr olhor* of pUoa 

g. Gar* up witbout trying 

h. tUd^MttforttoimpcoTvbdMTior.wor^orkMlthbabitiu 

-aumnr and <iimATm- 



a. W«iiiiMbUlod»vdapc^««vtTyilmpUkba wbaastattMtodtohia 

b. Wai anAbU lo work va'i pUa ig| •ctto* wbM boad bf vatRpoetod 
or mfinttitr Mhuttoa 

e« HAdbib«lQUto«ad«flafcaM«wlbiagtika«bH«Hdy»MM 



- iimcRnnr ■■ 1 

a. Cbattod la dAM or gaaa 

b. Cbtr.g»d «iVd«c, AHand ffccordi, ale. 
e. P»nl»d atotiba ot wwgdd n g 

d. BUaudotbanfarawavMMi 

a. IbldAtilMiood 

L ICipt loitMatirerutloUiwb«flottad 

a> Took pnpaitr ol albsct 



- SOCIAL ADJUSTIAtlir r i ■ ■ 

a. BafttMd to l«ko turai or tfaAta wtib maaoea 

b. Struck, puabad, rplt oo, threw IbLagi aI or lalMknd wtth aacflbtf 

IndivldiMi 

«. Miarwl or M«UUtMl Iba pmad pnpirtr ol o^olbtr ladiHdiuil. 
d. PUyad trteki oo, U mnd otbara 
a, Tattbd oa etb«n 



■ sEKsntvin w othws ■■■ ■ 1 

a. Utt uoUwr cfaOd oal ol activity 

b. Rtiorrod to aootbar'j cao>« nUgloo. or attfoatUly is A dlipuft0ia« 
nLAJutir ■* 

e. CftUad uotbvc child tuuuH 

d* M«da Km of or tMMd taolbAr tbont bAsdleap ^ 

a. L^uqbtd at lha mt rtr kat .ol ethan 

£. U«td rwcMSi and dlapartglio raawHs la .saAkiag crilMnM Aod 
ruggHtioM to or about olban 

-eiOUF OBHIITATIOtl ■ I 

a. Rahuad Co pwtidpato bi group tdivtty 

b. ' Talktd out ^ hua, ttlkad axcMolvaly, or aatwatad lor otbtra 

c. CoatiautUy intiBtod oa baiag Hnt 

d. Dimiptad and anaoyad tka group 

a. EiUbttod poor •poitcaaaabip to guM 
(. lafluaaood tilhara lo iU adiraataga 

-AttAPTAWllTY TO MIUS AND COMVIOTtOllg 

a. Ftitad to coaloria tp qaoar*l,nd>t el acbool or iliMirrifw 

b. DMtroyad or mutiUlad tmblio pKoparty 

e. -; FaLtad tooWrra tka rdag ol claaaUavMi good boaltb 
d. Sfco^ poor taala la butgoaga or adioa 

a* uvDooyoo oroora 
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PERSONA I 



BEHAVIORS TO BE ENCOURAGED 



SOHAL ADAJSTM£HT . 

R«act»d la a calm manner to threatening criticisnu auggestlo&c or 
punisbment 

Handled teesing, attacks of othert In e humofoui or unrotfled manner 
Reacted to failure in a conttructiTe mawer 
Adjuited well to diiliicult aituation 



SNHtSWUTY AfW EffORT 

Helped to clean up, arrange, or make special pivparatfon 

Did things prGmplly 

Got things done In spite of interference from otk^re 
Carried out aasignfid task without reminder 

Did unusually thorough job on assigned task or elected responsibility 
Notified others of special plans 

Made immediate ettorts to improve behavior, work, or health habits 
as suggested 

ATIVITY AHD MITIATIVI ' 



DATI rriM WHAT HAPPINIO 




J? 





























MP. 


B 

















Made up poem, song, or carried out some original or creative project 
Worked out satisfactory solution when faced by unfamiliar or un* 
expected situation 

Took over in response to special needs 
Attempted to Uarn special skilU on own initiative 
Volunteered to do sdme task 
Asked to m^ke up work 
Sought additional work 

IHTE6RITY — — — ^— 

Returned money or articles found 
Admitted guilt in some matter 

C. Made amends for own enors 

D. Called attention to mxxQi%, etc., that would have been to his advan- 
tage to ignore 



flhd. 



gj/. ^^^^ YfmHi-M^^' - 





C 





























S O C I A L 



SOCIAL ADJUSTiWENT ' 

A. Shared or took turns with someone 

B. Helped oHser children with school work or other ectivity 

C. Gave or loaned money or articles to others 

D. Qeve up something to help another 





B 






D 


JiiUa^L" hUfz^ J'dMjU^ 





















SIMSITIVITY TO OTHERS — 
A, Saw that others were not left out 



B. 
C. 
D. 

F, 
O. 



Cheered up, complim«ut«d, or encouraged othere 

Was kind to someone with handicap or special problem 

Tactfully provided lometbing for needy child 

Did something for person not feeling weU 

Conected or made suggestions to another in tactful manner 

Interceded for or stuck up for another 





3. 











GROUP ORIENTATION 

A« Offered to contribute to group activity 

B, Provided something for benefit of group 

C, Exhibiled good sportsmanship in game 

D. Communicated suggestion to the class 

E. Showed independent thinking in the face of opposition for group 
benefit 



AOAPTABIUTY TO ROIES AND CONVENTIONS — ^—i 

A. Followed rules even when unpopular to do so 
] O ted respect and courtesy for others in language or actions 
<^ I^G ^'^^ manners in difficult situation 
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Such an instriiment can be developed by adults, discussed 
with students, later revised and applied by peers, and finally 
might help the student develop his own self -evaluation. 



SUMMARY 

To summarize recommendations for measurement tasks In 



planning for NIE's School-to-Work Transition: 

A. Identify and monitor changes in the societal problem - 
As much as ppossihle, use existing surveys such as National 
Assessment and the Current Population Survey (CPS) to collect 
data^ In the case of CPS^ investigate the possibility of 
adding periodic questions on the qualitative nature of work 
experience for adolescents • Review and synthesize one-time 
studies that describe aspects of attitudes, aspiration, work 
experience, etc. 

Collect data for hypothesis generation about solutions to 
the ^roblem. ^-Wherever possible utilize data from existing 
longitudinal studies, pparticularly the Labor Department's 
longitudinal study of youth in the labor force (Pames Data)^ 
Perhaps an analysis project using this data could be Jointly 
funded by NIE and DOL* 

Monitor studies being done with Project Talent data for 
any Interesting findings. Send, as quickly as possible, some 
help to NCES in revising the instruments for their longitudinal 
study. Questions should be added on the qualitative nature 
of adolescent work experience and its relationship to later 
work success and attitudes ♦ Fund another collection and 
analysis of data for the Youth-in-Transltion Study, working 
with the project's research staff to ensure relevance of data 
that is collected Study treatments and effects used in 
manpower training programs --particularly Job Corpa and 
Neighborhood Youth Corps • 

C* Identify and legitimize desired outcomes- Adopt and adapt 
some existing set or objectives that fits program needa and 
has been exposed and received support publicly^ A good 
possibility Is the National Assessment COD obJectlvea« 

D# Identify and screen entering populations - Program designers 
should spend time observing stuaenits in work situations and 
collect data and insights on behaviors that relate to the 
program's desired outcomes* Study existing paper and pencil 
tests for format considerations in order to develop a test 
or scale that is consonant with observation data collected 
earlier* Investigate the content and availability of a teat 
of work attitudes, self concept, and motivation that la being 
developed by EES for Neighborhood Youth Corps« 

Ensure integrity and replicablllty of treatments for 
individuals and institutions > iievelop new measures for treat- 
ments and environments in an interdisciplinary efforts 
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Determine achievement of student outcomes and transfer 
control of evaluation to the students themselves ^ use 
existing administrative records to assess work -related behaviors. 
Develop a critical incident instrument for measuring student^ 
outcomes • Adults should use the instrument initially^ discussing 
the results with students. Small groups of students should 
revise the instrument and use it as a basis for providing 
feedback to members of the «roup in, a constructive^ » 
discussion setting. Finally, mechanics of using the measure 
should be transferred to the students themselves for guidance 
in self evaluation. 
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SCHOOL-TO-WORK TRANSITION 
POTEHTIAL RESEARCH AND DEVELOPMENT 
PROJECTS AND ACTIVZTIES 

Learning Experlencea 

Research on the effects of heterogcmeity or 
variability of work experience obtained by a 
student • Is it better to provide short periods 
of experience in a wide range of different oareers 
or longer periods of experience with a sauill 
sample of careers? 

Research on the effects of structuring the se- 
quence of work experiences o Is a progression of 
career experiences, carefully graded in difficulty 
so that development of coping skills prerequisite 
to more advanced opportunities will appear early 
in the sequence, prior to the point where they, 
will be needed, more effective than a more random 
sequence? 

Research on the effects of the nature of the work 
situation. What kinds of work experience are 
most helpful in inculcating appropriate attitudes 
and generalised coping skills in the student? 
Examine such variables as amount of pressure or 
tension, amount of decision making Involved, 
personality characteristics of ones fellow workers 
(uctent of prerequisite knowledge required on the 
job, and work setting. 

Analyses of obstacles to installation of eaqployer-* 
based education and design of proposed solutions 
for overcoming these obstacles. 

(a) Logistics studies, e.g., feasibility of in- 
tegrating students into eiqployment setting; 
entry and exit problems; termlnatlfltti and 
admission procedures; length of participation 
time; management studies; staffing; etc. 

(b) Economic problems - cost effectiveness 
studies, payment systems for student workers, 
school finance Issues related to allocation 
of resources to non-school agents to assist 
in programs. 
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(c) Legal and political problams - credit trans- 
ferability, accreditation, teacher certifi- 
cation , ndnlmum wage, health and safety 
Insurance, child labor lavs, trade entrance, 
apprenticeship credits, labor sMOiagement re- 
lationships. 

Experlxnental small scale trial and revision of 
proposed new work programs with projected plans 
for later wide scale In^lementatlo^ of those 
programs that are successfully developed. Zs^le- 
mentatlon plans must Include employer, student, 
and community Involvement; and manipulation of 
Incentives, Information, and laws neoessary to 
the ongoing maintenance of successful program 
operation beyond the R t D period • 

Development of job conqpetenoy measuring instruments • 

Development of Industry-basod education programs 
that supplement shortened work days or work weeks* 
The programs would Include apprenticeships to « 
prepare people for job rotation; partldpatio!^ In 
public service activities i opportunities to learn 
from and teach others of different age^ sex, race, 
etc.; help In solving Interpersonal and community 
problems; joint efforts to start new small business 
within the company fold, etc* 

Role Models 

Conduct tradeoff studies to determine how much It 
costs to prepare new teachers as compared to 
selecting, on the basis of teaching performance 
measures, persons from trade or professional 
groups who are already cooq;>etent and then re- 
cmltlng them Into teaching within their own em- 
ploying organisations. 

Evaluate the effects on students of Increased 
adult Staff diversity In pilot experiments In 
employment settings* 

School-Work Articulation 

Investigate various Incentive patterms that may 
permit the Implementation of a shortened period of 
mandatory school attendance with a recurrent 
pattern of education and work* Exan^les could 
Includes 
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(a) Ways of financing atudenta wish to raantar 
tha aduoation ayatttna, a national aducational 
opportunitiaa bank, a apacial loan program for 
ratttmaaa. 

(b) Tax daduotion inoantivaa for corporations 
that anabla workara to taka aabbaitioal laavas 
for raaduoation* 

Study proceduraa for using aducation vouihars to 
reimburse corporationa and other ptdbllc asqplc^are 
for on-the-job education prograaui* 

Support historical^ sociological, and anthropo- 
logical studies to invent new waya of inducing 
the non-school sector to accept ita educational 
responsibilities • 

Experimant with and evaluate school graduation by 
performance criteria similar to the QBD examina- 
tion rather than by years coapleted« 

Experimant with reducing mandatory attendance 
age and providing of a given number of yeara 
entitlement » A publicly accountable agency 
could issue a voucher for X years of achooling 
beyond graduation at age 14 for each eligible 
student* The voucher could be turned over to 
any sclxool or university v^ich had been desig- 
nated eui acceptable the agency and it could ba . 
spent at any time dr ^-ing the life of the student* 

Develop alternatives to the academic year cycle 
in order to spread out job oppdrtunitiaa and va- 
cation periods* 
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LOS ANGELES: CENTER FOR THE STUDY OF EVALUATION 

November 21, 1972 



TO; Dick Berry and Jean Brandes 

FROM: Bev Kooi (Consultant, UCLA's Center for the Study of Evaluation and NIE 
New Initiatives Program) 

SUBJ: NCES LONGITUDINAL STUDY - YEAR Om FOLLOW UP QUESIIONNAIRE . 

As you know, I have been exploring the existence of iDeasures that mi^t be 
useful in the various NIE New Planning Areas, particularly those related to 
adolescence and the transition of adolescents into adulthood. I appreciate the 
tiiiie each of you spent with me explaining the longitudinal study and receiving 
the materials and questionnaires. In a quick reading and categorization of the 
general and work (W) portions of the questionnaires, I caaie up with the following 
rougih content assignment of questions: 

Items on Iteas on 

Base Year Year One Follow-up 

Questionnaire Questionnaire 



Personal Data 1, 82-86, 88, 89, 92, 95 1, 4, 5, 14, 15 

Self Esteem 21, 28 7, 13 

Values 20, 24, 26 

Activities 7, 8, 10, 17 2, 6, 8 

Aspiration 25, 29, 81 9, 10 

Achievement 5 

SES ,93, 94 • 

Work 8, 9 17, 18 

School Variables 2, 4, 5, 18, 19 20, 21, W-IS, W-20 - 

Knowledge of jobs 

or acquiring a 6, 22, 23, 97-104 W6, WU, W12^ W16 

job 

^SSSg"^^^' 27, 30, 31, 96 3, 4, ML, W14, W19 

Influences on work 

or educational 3, 13-16, 87, 90-91 11^ 12, 14, W7 . 

plans 

Specific work or 

Educational 32-62, 65-80 W2-4, W-IO, W17-W18 

plans » 

This was an exercise to familiarize myself with your questicraaiTes, but 
I thoug^it you might be interested in vrtiat the content looks like to a naive 
reader. Forgive my miss -assignments. 

FRir several ways that revision of the q^iestionnaire might help the 

^i^^iers of new R § D to identify program needs in the area of adolescent 
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transition. First of all, the kinds o£ questions that would help us most are 
those that explore the effects of qualitative differences in high school work 
experience upon later attitudes and adjustment to work situations. The base 
year questionnaire seems to have only two questions about high school work 
experiences (#8 on hours per week in paid and ur^aid jobs, and #9 on how the 
student believes his job relates to his studies, future, etc.). Ifewevar, the 
Year One Follow-up questionnaire might well ask sane retrospective questions, 
since the analysis would be relating past experiences to present e^qleriences 
and feelings. For exanqple, we would be interested vdiether high school work 
experiences were voluntary or not, v^ether the students enjoyed the work or 
not, how many different kinds of experience they had, T^ether their jobs were 
ones adult co*workers depended on them to do or not, whether the students 
worked along-side adults or not, \^ether or not they received the same wage as 
adults who worked, \^ether or not it made any difference if they did a. good job^ 
how long it took them to learn their high sdiool jobs, etc. 

This high school job information, in turn, should be related to current 
feelings toward work and the work situation. The questions to get at such 
feelings will have to be carefully worded and qualitative in nature^ perhaps 
getting at feelings through asking about how the person acts at work. Two ques- 
tions from the Feelings section of the Study of Family Econoinics being done by 
the University of Michigan Survey Research Center mig^t serve as illustrations: 

"4. Would you say you nearly always finish things once you start 
them, or do you sometimes have to give t?) before they are finished?" 

"5. Do you spend much time figuring ways to get money?" 

Or, the person might be asked to respond to statesnents like the foXlowij^g: 

- I alBiost never stay home from work \^en I'm not ill. 

- The peq^le I work with think I do a good job. 

- The place i^ere I work could not get along without a persm 
doing my job. 

Finally, more direct questions about feelings themselves mig^t well get the 
attitudinal perspectives we need. For example, again fram the Michig^ Center's 
Survey: 

"1. Have you usually felt pretty sure your life would work out 
the way you want it to, or have there been more times lAen 
you haven't been very sure about it." 

A second kind of revision that might help the questionnaire and thus help 
everyone using it is to avoid questions that ask the same thing in several, 
seemingly indiscriminable, ways. Question #13 on the Year Oner Fbllow-iq) iUus- 
tratels this problem: 

"I take a positive attitude toward myself. 
I feel 1 am a person of worth^on an equal place witii others. 
I am able to do things as well as roost other people. 
On the ^le, I am satisfied with inyrself." 
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It is hard to tell }fAty all of these items are needed, and certainly hard 
to tell >diy they are put one after another. I should think the students would 
simply X through one number for all statements « or perhaps simply vary the 
mm^r bec^ise seeing all of the questions together leads them to believe that 
the examiner vrould like them to vary with slight dboiges in wording. I would, 
suggest shortening and rewording si^ items and substituting substantively 
different questions for those that are deleted. 

A final suggestion for the questionnaire is that the wording of many ques 
tions (on both One Base Year and Year One Follow*iq>) is awkward^ long^ and 
acadeflpdc. Consider the following exaaples taken &cm various questi<ms an the 
Year One Follow-tp: 

••10. I may leave for a time, but intend to ca^lete my present 
program of studies at my present school and plan to graduate some 
day.'* (one of seven choices for response on this question) 

•*12 How much have yovr parents or guardians encouraged you iii... . 
confoming to rules and regulations of tl^ coawnity?" . 

•W*3d Which one of the follcwiiig describes yoxr en9)lq)^^ 

- An enf>loyee of a private coopaiQ^, business or ixKULvi** 
di:al for w^gies, salary 9 or commissions. *^ (one of f<^ 
sudi choices uiider a 5-part question) 

I strongly recGonend that someone ^Aio knows kids and how they talk and tliink 
should revise the questionnaire. Periiaps some bright kixis should pairticipafte. 
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APPriDIX C 



PRELIMINARY PROPOSAL 

FIFTH WAVi: FOLLOW-UP IirTERVIEW 
YOUTH IN STUDY 

Survey Kefcarch Center 
The University of iiichigah 
Septcnbery 1972 



COKTACTS: 313/764-8560 

Sr. Jerald Bacbraan 
Dr. Jcrose Johnston 
Mr, Patrick O'Malley 
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Introchicttlon 

Since 1965 a nacionvido research project entitled Youth in Transition 
has been explorinj? a nur.bc*r of topics of in\port*nuce to youth in the United 
States. A najor enphasis has been placed on what ©any have called "the 
dropout problem." 

After a four-year sequence of interviews and re-lntervicws from more 
than two thousand young men, the study reached this basic conclusion: 

Droppins cut of high school is overrated as a problem 
in its own right — it is far more appropriately viewed as 
the end result or symptom of other problems which have 
their origin much earlier in life. The difficulties 
experienced by the dropouts we studied — the low aspirations 
and accomplishments, and even the limitations in self- 
esteem and self-concept — vrerc already present or predictable 
by the start of tenth grade, and there is little evidence 
that dropping out made matters worse (BaclEnan, et al., 1971, 
p. 169). "" 



The data from the study, collected from 1966 (vfaea the respondents were 
starting tenth grade) until 1970 (when most had been out of high school for 
a year), fully support that conclusion. Nevertheless, the authors 
acknowledged that much more remained to be learned: r . - 

We have stated these conclusions based on the evidence 
presently available. At the same time we recognize the 
lliulLalluns of a study which lulluw;* yuuug men only xmtil 
the age of 19 or 20. We are hopeful that further follow- 
ups of the Youth in Transition respondents will be possible, 
thus permitting an assessment of dropouts and staylns in 
their mid-tventies and perhaps still later (Bachman, et al. , 
1971, p. 183). 

The present memorandum outlines, in a preliminary way, a proposal for such 
a further follow-up of the Youth in Tr«insition respondents, with particular 
emphasis upon later occupational attainments of dropouts and high school 
graduates. • ' - 

Oblectives * " 

We are proposing a data collection in Fall, 1973, which would provide 
additional information on job and educational status at a point four to seven 
years beyond the high school experience. For the 1600 young men in the sample 
there already exist extensive records on family background and personal 
characteristics, as well as attitudes, behaviors and job experiences during and 
Immediately after high school. 

Th« ;*nn1yRp<i which wnuld he performed would have twv Interrelated thruntP. 

One of Cho rr.jor rrirort ici'J':: to .itJdr^': 'o^! " '.r: ??r:--rari;:od\:r th'.* inl r'.*!::'U:t im: 
^ is dropping; out of hi&h i>ci*ool i\.iiaceci to luuOC job accaini/i^t luw. s.xl ii^u.cii^ui 
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If 80, does the relationship rer.ain once controls for family background 
and intolligoncc are introduced? In other vords, does the conpletion of 
high school (and the resulting diploma) p.ake a concrete difference in 
the quality of job v/hicli an individual can obtain? Our earlier findings, 
based on attainments shortly after hi{;h school, indicate that dropouts are 
indeed less frequently eiiiployed than graduates, but that this can be more 
parsimoniously explai.ied by traits and characterii?tlcs x^hich were identified 
before the* individual entered high school rather than by the individual's 
failure to coniplete high school. Comparing employed dropouts with employed 
graduates vho did not go on to college, ve found them aluost identical in 
terms of the status of jobs held and th^ income received, even after 
controlling for length of time on the job. 

An additional data collection is needed to see if the findings suinpjarized 
above continue to hold up after several more years in a job setting. This 
would enable us to evaulate the hypothesis that there are indeed differences 
in occupational attainment and earnings between dropouts and stayins, but 
that these differences shov; up not in initial job attainment but rather as 
the result of a differential ability to obtain promotions or move into better- 
paying jobs. 

A second related analysis thrust vould examine the range of employment 
experiences for th^ whole sample and see what factors from an earlier time 
are related cd them. Some of the objectives are these. 

1. Examine the impact of early part-time and part-year job experiences 
during school. Do they result in greater persistence at a full-time job later 
on?. In other words, do they provide valuable work experience for youth? 

2. Describe employment patterns, trying to distinguish between those 
vho manage to remain steadily employed and those who stay on a job only long 
enough to earn money for immediate needs and then quit. Having distinguished 
some patterns^ search for correlates of the behavior. 

3* Describe the standards by which jobs are judged acceptable to differ- 
ent youth. Uhat is the importance of wage expectations held prior to employ- 
ment? Hov important is challenge in a job in comparison with the pay being 
offered? 

A number of other questions will appropriately result from collaboration 
betveen the research ^staff and the sponsor. In addition, it is planned that, 
the tteasures will include a core of repeated items from previous Youth in 
Transition data collections. 



Sample 

Ve anticipate a sample size slightly larger than 1600. This number is 
based on our experience in the last data collection and the fact that we expect 
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CO use intensive track-^down procedures for those we have identified as 
having dropped out oi: high school. Ve anticipate that the sample will 
distribute roughly as follows. 



Expected Status, Approximate 
Fall, 1973 Number 



In the labor force for 

4 or more years 550-600 

In the labor force for 

1-4 years 500-550 

Graduated from college 

and entered the labor 

force within last year 

or continuing advanced 

education 325.3^5 

Military Service lOO-lSO 



Timing 

The data collection itself is planned for the fall of 1973. Work 
would have to begin in the first quarter of 1973 to prepare for the field 
operation. A final report on the results could be readied by Fall, 1974. 



Principal Investigators 

The three principal investigators for this project include Jerald 
Bachman, Program Director; Jerome Johnston, Study Director; and Patrick 
O'Malley, Study Director. Dr. Bachman has directed the Youth in Transition 
Project from its inception seven years ago. Dr. Johnston has been aftili* 
ated with the project since 1968 and is a major author in the monograph 
series. Mr. 0*Malley has been analyzing d^ta on the project for several 
years and is soon to complete his Ph.D. dissertation based on data from 
the project. 
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Proposed liudget 
Wave 5, Youth in Transition Study 
(18-Konth Duration) 



Total Research Personnel * $ 87»810 

Total Field Personnel $ 80,479 

Keypunching and Data Processing Total $ 10,000 

Total Supplies and Materials $ 11,000 

Total Travel (including interviewer staff and 

research staff) $ 18,000 

Payment to Respondents $ 16 > 000 

TOTAL DIRECT COSTS $ 223,289 

INDIRECT COSTS - 95,420 

TOTAL WIDGET 318.709 
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P E R S O 



BEHAVIORS TO BE ENCOUBAGED 
DATE mM 

PflSOMAl AOfllSTMlMT — — « — 

A. BMcted in d calm UMxmor to tbj«at«xxisg cciticum, aug9«stioxi« or 
panUhmenk 

B, BudM ttasiAg, Attacks ol othert la humorous or unruffiKi mana«r 
Ci Btact«d to iailuro In a conatructiTtt nanner 
D. Ad{uAlad wtU to difficult sibution 



WHAT HAPPINID 



RISPONStBlUn AND EFFORT ■ ' — — 

JL H«lp*d to clean up, axrAage, or makA spediAl piAparatiaa 
B. Did things promptly 

Got things done in spite of interference from othecv 
Carried out assigned Usk without remiader 

Did unusually thorough job on assigned tasit or electsd responstbiliij 
* . Hotilied others of spedai plans 
O. Kade immediate eOorta to improve behanor, work, or health habiti 
as suggesied 

OEATIVITY AND INmATIVE — — 



C 
D. 
E. 

r. 



mo 


B 























A. Made up poem, «oag, or earned out some original or creative project 

B. Worked out satisfactory solutioa when faoed by vxiamiliai or ua- 
expected situation 

C Took over in response to special needs 

D, Attempted to Uarn special tkilU on own initiative 

XL Volunteered to do some task 

F. Asked to make up work 

G. Soa^ht addttional work 



(0/5 


F 










/O/tJi 






/■2./I9 


c 











A* Returned money or articles bund 

B. Admitted guilt in tome matter 

C. Rado Amends for own errors 

D. Called attentioa to errors^ eh;., that woold have bem to his advan- 
bQO toignoro 





c 











SOCIAL 



SOaAL ADJUHMEKT 



A Siared or took turns with someone 

B« Belpod other children with ichool work or othAr Activily 

C Gav* oc loAnAd money or articlee to others 

O. Ga'vo up something to h^p anolhw: 



/TMTfML- M^d^ JdMjQu^ ' 



SENSmVITT TO OTHERS ■ 

A Saw thai othArs wata not left out 

B. C h oArAd up, GompIimeQiod, or ©ncouiaged othAra 

C. Was kind to someone with handicap or special probloa 
Tactful] jr provided somAthing for needy child 

EL XHd something lor person not feeling well 
. F. Corrtcted or made suggestions to anolhAr in tactful manaer 
O. Enterceded for or stuck up for anolhAr 



CROUP CaiEHTAflOK — ^— — — ^— 
A OffexAd to contribute to group activity 

B. Frovidsd something for benefit of group 

C. Exhibited good sportsmanship in game 
O* Communicated suggestion to the class 

S. Showed independent thinking in the face of opposition for group 
benefit 



ABAFTABIUTr TO RULES AND COKVENHONS 



C 



Followed rules even when unpopular to do so 

E»hibitAd respect and courtesy lor others in language or actions 
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P E Si S O A I 



ISOMW MJUSTMENT — — — ^— — «— — — _ 

I B*«ct«d in ft cMlm mAnxun to thxvakemn? criticiiia« augg^sUon, or 
I pqniibroant 

B«adl«d toAsing, attacks of others in • humorous or unruKltd manner 
B#ocisd to Cailuro in a constnictiTa nnv^nnar 
Adiofttad wall to difficult situation 



BEHAVIORS TO BE ENCOURAGED 
DAu rrcM 



WHAT HAPPINIO 



spoNSfstimr and ctfort 





p 


























' — 



Kaipad to claan up, arrange, or make special piaparatlon 
Did things promptly 

Got things done in spitfr of intorfereace from others 
Carried out assigned task without remindar 

Did unusually thorough job on assigned task or elected responsibility 
KotiUed others of special plans 

Hade immediate eUorts to improve bahanor, work, or health habits 
as snggested 

KUTIVITY AND INiTIATIVE — ^— ^— ^_ 



mo 


E 

















Made up poem, soag, or c&xried out some original or creative project 
Worked out satisfactory solution when faced by uixfamiliar or un> 
expected situation 

Took over in response to special needs 
Attempted to Uarn special akilU on own luitiatiTe 
VoIuDteered to do some task 
Asked to make up work 
Sought additional work 



rECRITY 



Returned money or articles found 
Admitted guilt in some matter 
Made amends for own errors 

Called attention In errors^ etc., that would have been to his advaa- 
I to ignore 





C 











SOCIAL 



lAl ADAISTMENT 



Shared or took turns with someone 

fiUped other children with school work or other ectiTity 

Gave or lo«aed money or artidee to ctheon 

Gave eomethiag to h^p another 



m 


0 






V 


yiia&a.^ ke/^jy, n^^<^ 





















SmvnY TO OTWRS — — ^— ^— — — 

Saw thai others were not left out 

Cheered np, complimeat^ or encouraged otK#re 

Was kind to someone with handicap or special problem 

Tactfully provided somethiag for needy child 

Did fomethiag lor -^i^oti not feeling wi^ 

CoKTVcled or made suggestions to another in tactful manner 

Hterceded lor or stuck up (or another 





3 




n/do 

























ySWm ORtENTATfON — — — — — 
liL Offered to contribute to group activity 
IB. Provided something for benefit ol group 
|C* Eahibiled good sports ma txship in game 
ID. Communicated suggestion (o the class 

|2L Showed independent thinking in the Uoe of opposition for group 
benefit 



AfrAFrABiimr to rules and conventions 



ed ndes even when unpopular to do so 
^ ted respect and courtesy for others in language or actions 

in difficttlt tttuation 




TRAITS 
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BEHAVIORS NEEDING IMPBOVirMENT 



OATI 



ITIM 



WHAT HAPPINeO 











Ji 


















h 







PERSONAl ADIUSTMENT- 



a. R«act»d to tuggtstioo^ putushm«nt, or testing with: 

a*l. sulking, hostile remarks, tantrumi crying, door tlamming, i 
,a*2. running away irom tituatton, hiding face. ele. 
b* Cried, complained, or wai up«et ovar aaall matter 
Q. Had difficulty adiniting to liluatloa 

d. Failed to participate with group, withdrew 

e. Feigned lickaetf or gave excuse to avoid dSSISfteiul aitv^tion 

RISPONSiSILITY AND EffORT 

Attempted to avoid doing his ahare of^ work 
Did not carry through with assigned task 
Dawdled or was late in doing tasks 
Failed to do work or made UHle effort 
Lost, wasted, or (ailed to care for euppUeir money, etc- 
i:. Failed to notify others of plana 

g. Gave up without trying 

h. M«denoeiiort lotraprove behavior, work,orh.ealth habib as su^ 
UEATIVITY AND IMffiATIVE , ■ 



c. 
d. 



a. Was uiuhia develop oven very simple idea when presented to j 

b. Was unable to work oat plan actioa whoa faced by una 
or nnf a miliar aitoatkia 

o. Had tci be told to undeitake somothing that obvtouriy needed t 



a. 

b. 

c 

•« 

L 



Cheated In dass or game 
Changed gAkdee, altered recarda# otc. 
Denied mistake or wrongdoing 
Blamed others for own mistakes 
Tcdd a falsehood 

Kepi loel money or axttdaa when bnnd 
Took pi ope it y of odbera 



TRAITS 



ERiciis: 



-SOCIAL ADJUSTMENT < 



d. 



Refused to take tome or share with eomeono 
Struck, pushed, spit cm, threw things at or interfered with 
individual 

Destroyed or mulileted tiM personal piup o fty of anolbor iadividi 
Played tricks on, tossed othera 
Tattled on others 



-SENSITrnTTTOOTiraS* 



a. Left enother child out of activity 
b* Referred to another'a rack# religion, or natlonaiity in a dlspscragi 
manner 

e. Called another <^nld names 
d. Made fan of or teased another about handicap 

Laughed at the mietaket of others 

f. Used saiaism and disparaging remarks in making criticisms ai 
suggeaftionii to or about others 

■GROUP CRfENTAnOW 



a. Refused to paxtidpato in group activity 

b. Talked out of turn, talked ezoessivoly, or answered for others 
cu Continually insisted on being first 

d. Disrupted <nd annoyed the group 

£xhiinted poor sportsmanship in game 
L Inilueaoed others to ill advantage 



-ADAPTARlUn TO RUIIS AND CONVENTIONS • 



c. 
d. 



Failed to conform to general rules of school or classroom 
Destroyed or mutil^ed public pf.C'v>party 
Failed to observe the nUee of cleanliness, good health 
Showed poor tasto la langoage or aetton 
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Appendix □ 

behavioral Cutcomes for Students 

Part I. Unpublished Objectives 

Part II* Two Secticms oF Mational 

Assessment's Career and Occupational 
□evelopment Objectives 



BEST COPY AVAILABLE 



Part I. Character isrics of people <no Have «rucccc^=,?='ul 1 y metf.*-f»d 

1^ THny Fg*?! in* con-tro l thoir osn rar*c;nn;?) 1 iv«?c^ . They can 

zt^tt* tho purr,»oso oF their own acti vitiec n'^d the con<ionuG'^c:e'3 
they expect fron> them. They balance their own nrtivity [e.g., 
work, *-c5;t, recrR=ition, jsprvice, etc.] over ti»n^ and in new 
set-tinnB. They provide for persoo©! Financi al «3f*rur i ty duninrj 
© crisis Ce«9. » by purchasing insurance, budgeting income, 
saving money, et:c,] 

2» They have relatively accurate ^elF-knowledne , They judge their 
Ciwn work or product quality with feir accuracy and do rot 
^seriously over-or underestimate their own strengths and 
weaknesses, 

3.* They enjoy learning new things . Because the process oF learning 
and the development oF new skills is Fun For then, they have 
gained success in perFonrring a number oF tasks and can perForm 
the ?=?ame task under varying circumstances. They can switch 
From leading activities to working independently or accepting 
direction From others as appropriate. 

A, They are skillFul at getting inFormatxon , They can Find end 

approach &ppropni&-t^ pef^sons to get inFormat it?n , can 

systematically ask questions that result In needed evidence 

and can Fill gaps in clarity oF instruction or information* 

5. They can make decisions and Follow up on them . They can 
understand the interdependence oF a sequence of decisions. 
TKey -take respon??ibi 1 i ty For personal decisions and For 
on-the-job judgments that have real business consequences. 

Thc»y cnnFidently e^n^i^e in activities^ including wn^^k . They 
can Find activities that suit their own interests and needc 
and know that appropriate work or servico to ethers ci?n be ?9 
s'Turc* c^ pe'^':?C'^'3 ! s^t isFaction. They F*»ei • 3\S>? to «»"»d 
responsible F^cr choosing en cccucation. They can compare a 
job or job setting with their own needs and interests, and 
do not place unreasonable limitations on acceptability of 
jobs or other activities. They Feel able to perForm successful I 
on a job. 

7, They a^e organ iz*»H ^y^d h ave good work habits . They ca" 

identl*^y and comply with regulations to get a permit, license, 
vari?=rrce, Job application, etc. They are gener-ally punctual ?i"d 
organizre time to meet maj^'^ deadlines, ^*"ey persist at a task 
until it is completed or obviously ill corceived. 



BEST COPY AVAILABLE 
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recQ2»^Tze tha't people Have F^«»-ent: atti t:ud<?s '^nw»»^d wr^^, 
Fr i pnd'^shi p , and liFo »n c;f5nf»r*»i , T^«y resprc^ end »5dni'^i» 
otihorB who try to Brhif»vf» t:r> the beot of th<»ir »b?lft:.y 
and fecnnnize excellence ©tts^ned by those who have dlFF»rFnt 
interests, values, and work Fields, They encourege others 
to develop and to use their skills and abilities to achieve 
maximum corrpetence. 

10, Th>.>y ggr-'e considerate in group, settj'^gs . They are willing to help 
others lear-n or to pi^ovide inForrratlon they may Find useFul • 
They do and return Favors as appropriate and accommodate 
special needs and skills oF othe*^ member's oF grc»jps Ce,g., 
blindriess, special knowledge or experience, etc,3« They are 
considerate in teamwork settings [e.g., pick up belongings 
aFter use, work quietly, do not interrupt others, do their 
Fair share oF work, etc,] 

J I. They accept Family and community responsibility . They work 
around the home, ca»^e For the young or ill, give service to 
orgienizations, help protect the envir-onment , etc. They 
provide For such secondary responsibilities while holdinn a jph. 

12. They a'^e willing to judge or question others . They CBn 
judge the work or product oF others hut be discreet about 
the shortcomings they discover. They question regulations or 
demands oF others that seem arbitrar«y unwise [e.g. , hlgh- 
oressu^e salesmanship, unnecessary rules or* deadlines, fete. 3 • 
They can communicate unpleasant inFormation when necessary 
Cs.2« f an apartment mate is disturbing others, an employee 
must be Fired, a peer's products are not up to standards, etcS.] 

8,. THey ar^e aTgr^t to new opportunities . They Frequently generate 
new ideas or variations oF techniques on the job. They 
routinely compare new ideas and opportunities with old o'^eT?, 
and oFten use their own time and Financial resources to be^in 
new activities or learn new skills. They attempt, as appropriate, 
to convince others oF the worth oF their ideas. 



ERIC 



part II. National Assessment COD Objectives 



OljecCiveID2,Aduh 

exploited; impending layoffs; conflicts with supervisors; 
internal politics; health hazards). 



a mPROVE CAREER AND OCCUPATIONAL CAPABIUTIES 

Alor^ with planning for a career goes the actual doing of things that further 
those plans or that widen one's knowledge and skills. This objective is 
omoerned with the implementation of career plans and with active ' 
particq)atk)n in both in-school studies and out-of*scho<d activities that 
enbaixe one^s career and occupational capabilities. 

Age 9 (1) Attempt to gain as much as possible from school. 
(Behaviors requisite to success in school are given under 
Objective IV-Practice Effective Work Habtts.) 

(2) Do home chores (for example, run errands; water flowers; 
care for animals; help with cleaning; take care of younger 
siblings; prepare parts of meals). 

(3) Engage in hobbies (for example, collect stamps, rodcs, 
and coins; read; draw; paint; play musical instruments). 

(4) Visit places of Interest in the conununity (such as 
idanetariums, aquariums, dairies, newspaper plants^ muse- 
ums, zoos, factories, colleges). 

(5) Partidpate in extracurricular and community activities 
(such as scouts, 4-H, school clubs, organized sports, contests, 
amateur shows). 

(6) Use school and public libraries. 

(7) Watch educational television programs. ? 

Age 13 (in addition to Age 9) 

(1) Attend educational events outside of school (such as ' 
science, agricultural, trade, and county fairs; musical pro- 

grams; auto sliows; plays; travel lectures; art exhibits; 
indusi^ial displays). , - 

(2) Engage in part-time work (such as delivering papers, 
baby -sitting, gardening, helping in stores, raising livestock). 

(3) Participate in coursework outside of regular school 
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Olijective U,Adiih 



(4) Participate in company-sponsored tiainiiig pragnns (for 
example, management, technical, academic^ildUed). 

(5) Join professional and vocational oiganizatiom, tododirg 
unions, to be eligible for training programs, advancement 
opportunities, placement services^ periodic pid>licationa, 

(6) Study toward, and take any necessary exanuoatidns far, 
professional registration and certification (for exunpie, 
engineering fields, architecture, teaching and other educa* 
tional services, cosmetology, boiler operation, and acooost- 
ing)- 

(7) Attempt to renew and broadm interests and vdues 
(maintain relevancy of focus on their occupationi). 



ni. POSSESS SKILLS THAT 
GENERALLY USEFUL IN THE WORLD OF WORK 

The six main categories of generally useful skills are numerical, communica- 
tions, manual-perceptual, information-processing and decision-making, inter- 
personal, and employment>seeking. Some of these skill categories apfrily to 
other subject areas in the National Assessment besides caree. and oocupa- 
tional development. For example, communication skills are related to both 
the reading and writing areas; numerical skills are included in the mathematics 
area; information*processing and problem-solving skills include many social 
studies behaviors; and some work habits and interpersonal relations are also 
found in citizenship. To minimize overlaps, practical or on-the-job behaviois, 
rather than academic skills^ have been selected to illustrate the COD 
subobjectives whenever possible. Second, measures common to other aub|ect 
areas will not be used in the assessment of generally useful ^iUs but wiO be 
referenced in reporting of results. 

Although not strictly a generally useful skill, employment-seeking skill has 
been included under this objective. It is useful not only for initial job entry 
but also for improvement of occupational status and is a necessary complenient 
to the other generally useful skills. 

A. Have generally useful numerical skills, 

1. Perform calculations and transactions involving money. For example: 

Age 9 Make change; total up own purchases; do very simple mental 
computations without figuring on paper. 
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Objective IV E, Ages 17 and Adult 

(2) Take good care of clothes (for example, properly launder 
and iron or dry clean; repair; store properly)* 

(3) Have regular medical and dental checkups. 

(4) Seek professional help when needed (for example, 
doctor, dentist, and psychiatrist). 

V. HAVE POSITF^ ATTITUDES TOWARD WORK 

Today more than ever there is a great diversity of life styles. An occupation 
or career is only one way of achieving personal self*fuinilment in life. 
Neverti\ele$s, it is possible within the context of career and occupational 
development to identify desirable attitudinal goals that should result from the 
educational process. Thus, National Assessment seeks to assess attitudes 
toward woric not only in terms of societal goals but also as acceptance and 
understanding of the diversity of life styles, regard for competence ind 
excellence in endeavors of many different kinds, and pride in one's own 
achievements. 

A. Recognize the bases of various attitudes toward work. 

Age 9 Know that some people have jobs and others do not 

Age 13 Know that appropriate work can be a sd|arce of personal 
satisfaction. | 

Ages 17, A (1) Recognize that people have different Attitudes toward 
work (for example, know that some people work only for 
the money, that some people find their work absorbing and 
revmding, that some people avoid looking for jobs, and that 
some people place work second in importance to other mott 
personally meaningful activities). 

(2) Understand why people have the attitudes that they do 
toward work (for example, understand that alttitudes toward 
work are affected by many factors, such as education, age, 
sex, family income, race, religion, nationality, woric e3^)en- 
ence, and self-concept; know that some people have expe- 
rienced inequalities in obtaining work and on jobs; know that 
the '*work ethic" is a predominant attitude in America's 
history; know that differences in social, ethnic, radal, and 
educational background make it easy for some people to 
obtain good jobs and difficult for others to obtain any job; 
recognize that frustrated ambitions may affect attitudes). 
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Objective VD^Addt 



(4) Work to extend civil rights in the world of woric to tB 
persons r^ardless of race, rdjgion, sex. or ethnic or 
eodoecmiomic origin. 

(5) Believe that members of both labor unions and business 
groups should strive to be ethical in the stand they take on 
labor-management issues. 

(6) predate the advantages and disadvantages to Ubof 
unions, employers, and the public of existing labor legisb- 
tion, such as the nmchinery for settling labor dilutes, 
regulation of union practices^ and antitrust laws. 

(7) Maintain high personal ethical standards to contrfiiute to 
the standards of their companies and vocations or profo- 
sions. 
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